Week 1

Milestones

• Understanding the flow of the AI-tools and what my project flow would be.
• Researching a method for chunking free text out from a stream of string.
• Implement a benchmark model and test it's results.
• Comparing the results with Jugalbandi API's method for text chunking.

Contributions

• Here's the link to the google colab notebook used to create a benchmark and test it against Jugalbandi API

Learnings

• Looked out Mertics for Text segmentation and how to calculate them such as Pk value, WindowDiff, Precision and Recall.
• Learned about text segmentation using Cosine similarty method.
• Learned a little bit about prompt engineering from my mentor to get our desired results from chatGPT.